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The MAILING DATE of this communication appears on the cover shoot with the correspondence address- 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1308. 

1 - O This communication is responsive to Amendment filed on May 12. 2004 and IDS on 8/10/2004 . 

2. El The allowed claim(s) is/are 1-19 . 

3. (3 The drawings filed on 18 June 2001 are accepted by the Examiner. 

4. □ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

a) □ All b) □ Some* c) □ None of the: 

1. □ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 

3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

5. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 

INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

6. □ CORRECTED DRAWINGS ( as "replacement sheets") must be submitted. 

(a) □ including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1) □ hereto or 2) □ to Paper No./Mail Date . 

(b) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of 

Paper No./Mail Date . 

Identifying indicia such as the application number (see 37 CFR 1.84(c)) should be written on the drawings in the front (not the back) of 
each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 

7. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 

attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 



Attachment(s) 

1. S Notice of References Cited (PTO-892) 

2. □ Notice of Draftperson's Patent Drawing Review (PTO-948) 

3. Information Disclosure Statements (PTO-1449 or PTO/SB/08), 
Paper No./Mail Date 8/10/2004 

4. □ Examiner's Comment Regarding Requirement for Deposit 

of Biological Material 




5. □ Notice of Informal Patent Application (PTO-152) 

6. □ Interview Summary (PTO-413), 

Paper No./Mail Date . 

7. □ Examiner's Amendment/Comment 

8. 03 Examiner's Statement of Reasons for Allowance 

9. □ Other . 



U.S. Patent and Trademark Office 

PTOL-37 (Rev. 1-04) 



ce of Allowability 



Part of Paper No./Mail Date 6 



s <1 

Application/Control Number: 09/883 ,4 1 5 Page 2 

Art Unit: 2165 

DETAILED ACTION 

1. Applicant's Amendment filed on May 12, 2004 in response to the Examiner's Office 
Action has been reviewed. 

2. Claims 1-19 are presented for examination. 

3. Applicant's arguments filed on May 12, 2004 have been fully considered and they are 
deemed to be persuasive. 

Allowable Subject Matter 

4. Claims 1-19 are allowed over the prior art of record. 

The prior art of record fails to teach or suggest individually or in combination concatenating the 
visual feature vectors and the textual feature vectors into one or more unified feature vectors and 
categorizing at least a portion of each of the multimedia items by categorizing respective ones of 
the unified feature vectors as set forth in independent claims 1, 7, and 15. 

Dependent claims 2-6, 8-14, and 16-19 being further limiting to the independent claims 1, 
7, and 15 respectively, definite and enable by the Specification are also allowed. 

The closet prior art, Jain et al. US Patent No. 5,983,237 teaches a visual information 
retrieval system that performs generic image processing enhanced by adding a query 
transformation unit and a query expansion unit. With these additional components, a user may 



Application/Control Number: 09/883,415 
Art Unit: 2165 

present a query either as a text term or as an image, 
render Applicant's limitations above obvious. 
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The closest prior art fails to anticipate or 



5. Any comments considered necessary by applicant must be submitted no later than the 
payment of the Issue Fee and, to avoid processing delays, should preferably accompany the Issue 
Fee. Such submissions should be clearly labeled "Comments on Statement of Reasons for 
Allowance/ 1 

6. Any inquiry concerning this communication or earlier communications from' the 
examiner should be directed to Thuy Pardo, whose telephone number is (703) 305-1091. The 
examiner can normally be reached Monday through Thursday from 8:30 AM to 5:00 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Dov Popovici, can be reached at (703) 305-3830. The fax phone number for the 
organization where this application or proceeding is assigned are as follows: 

(703) 872-9306 (Official Communication) 

and/or: 

(703) 746-5616 (Use this Faxtt, only after approval by Examiner, for "INFORMAL" or 
"Draft" communication. Examiner may request that a formal/amendment be faxed directly to 
then on occasions). 

Any inquiry of a general nature of relating to the status of this application should be 
directed to the Group receptionist whose telephone number is (703) 305-3900. 



Application/Control Number: 09/883,4 1 5 Page 4 

Art Unit: 2165 



7. Any response to this action should be mailed to: 

Commissioner of Patents and Trademarks 
Washington, D.C. 20231 
or faxed to: 

(703) 308-9051, (for formal communications intended for entry) 
Or: 

(703) 308-5359, (for informal or draft communications, please label 
"PROPOSED" or "DRAFT") 

Hand-delivered responses should be brought to Crystal Park II, 2121 Crystal 
Drive, Arlington. VA., Sixth Floor (Receptionist). 

July 22, 2004 




THUYN.PARDO 
PRIMARY EXAMINER 



